Skip to content

Remove appsec_no_iast benchmark scenarios#8958

Merged
smola merged 1 commit intomasterfrom
smola/remove-appsec-no-iast-benchmark
Jun 11, 2025
Merged

Remove appsec_no_iast benchmark scenarios#8958
smola merged 1 commit intomasterfrom
smola/remove-appsec-no-iast-benchmark

Conversation

@smola
Copy link
Copy Markdown
Member

@smola smola commented Jun 11, 2025

What Does This Do

This scenario corresponds to a combination of AppSec enabled explicitly and IAST disabled explicitly. It is an uncommon scenario used back in the day to validate some features, but of little use today. And slightly confusing, because having appsec and appsec_no_iast misleads into thinking that "appsec" has IAST enabled. Let's make some room for useful scenarios.

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@smola smola requested a review from a team as a code owner June 11, 2025 07:59
@smola smola requested review from bric3 and removed request for a team June 11, 2025 07:59
@smola smola added tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Jun 11, 2025
@smola smola requested review from manuel-alvarez-alvarez and removed request for bric3 June 11, 2025 07:59
@pr-commenter
Copy link
Copy Markdown

pr-commenter bot commented Jun 11, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/remove-appsec-no-iast-benchmark
git_commit_date 1749573424 1749628630
git_commit_sha 3853c65 3d21dd5
release_version 1.50.0-SNAPSHOT~3853c65296 1.50.0-SNAPSHOT~3d21dd596f
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1749631007 1749631007
ci_job_id 976256582 976256582
ci_pipeline_id 67415803 67415803
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-qrcmbjps-project-304-concurrent-0-c0dp5ndy 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-qrcmbjps-project-304-concurrent-0-c0dp5ndy 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 13 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~3d21dd596f, baseline=1.50.0-SNAPSHOT~3853c65296

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.027 s) : 0, 1026922
Total [baseline] (8.512 s) : 0, 8512481
Agent [candidate] (1.023 s) : 0, 1023080
Total [candidate] (8.483 s) : 0, 8483277
section iast
Agent [baseline] (1.149 s) : 0, 1148634
Total [baseline] (9.151 s) : 0, 9150523
Agent [candidate] (1.151 s) : 0, 1150504
Total [candidate] (9.132 s) : 0, 9131851
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.148 s) : 0, 1148240
Total [baseline] (9.094 s) : 0, 9093635
Agent [candidate] (1.148 s) : 0, 1148325
Total [candidate] (9.085 s) : 0, 9085100
section iast_TELEMETRY_OFF
Agent [baseline] (1.146 s) : 0, 1146307
Total [baseline] (9.175 s) : 0, 9175203
Agent [candidate] (1.148 s) : 0, 1148200
Total [candidate] (9.184 s) : 0, 9183963
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.027 s -
Agent iast 1.149 s 121.713 ms (11.9%)
Agent iast_HARDCODED_SECRET_DISABLED 1.148 s 121.318 ms (11.8%)
Agent iast_TELEMETRY_OFF 1.146 s 119.385 ms (11.6%)
Total tracing 8.512 s -
Total iast 9.151 s 638.043 ms (7.5%)
Total iast_HARDCODED_SECRET_DISABLED 9.094 s 581.154 ms (6.8%)
Total iast_TELEMETRY_OFF 9.175 s 662.722 ms (7.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.023 s -
Agent iast 1.151 s 127.424 ms (12.5%)
Agent iast_HARDCODED_SECRET_DISABLED 1.148 s 125.245 ms (12.2%)
Agent iast_TELEMETRY_OFF 1.148 s 125.12 ms (12.2%)
Total tracing 8.483 s -
Total iast 9.132 s 648.574 ms (7.6%)
Total iast_HARDCODED_SECRET_DISABLED 9.085 s 601.822 ms (7.1%)
Total iast_TELEMETRY_OFF 9.184 s 700.686 ms (8.3%) 
gantt
    title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~3d21dd596f, baseline=1.50.0-SNAPSHOT~3853c65296

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (687.562 ms) : 0, 687562
BytebuddyAgent [candidate] (683.064 ms) : 0, 683064
GlobalTracer [baseline] (240.116 ms) : 0, 240116
GlobalTracer [candidate] (239.923 ms) : 0, 239923
AppSec [baseline] (56.338 ms) : 0, 56338
AppSec [candidate] (56.836 ms) : 0, 56836
Debugger [baseline] (6.136 ms) : 0, 6136
Debugger [candidate] (6.135 ms) : 0, 6135
Remote Config [baseline] (737.06 µs) : 0, 737
Remote Config [candidate] (740.306 µs) : 0, 740
Telemetry [baseline] (12.312 ms) : 0, 12312
Telemetry [candidate] (12.902 ms) : 0, 12902
section iast
BytebuddyAgent [baseline] (801.213 ms) : 0, 801213
BytebuddyAgent [candidate] (803.679 ms) : 0, 803679
GlobalTracer [baseline] (230.271 ms) : 0, 230271
GlobalTracer [candidate] (229.917 ms) : 0, 229917
AppSec [baseline] (53.997 ms) : 0, 53997
AppSec [candidate] (51.478 ms) : 0, 51478
Debugger [baseline] (5.969 ms) : 0, 5969
Debugger [candidate] (5.935 ms) : 0, 5935
Remote Config [baseline] (593.471 µs) : 0, 593
Remote Config [candidate] (593.576 µs) : 0, 594
Telemetry [baseline] (7.848 ms) : 0, 7848
Telemetry [candidate] (7.869 ms) : 0, 7869
IAST [baseline] (25.276 ms) : 0, 25276
IAST [candidate] (27.519 ms) : 0, 27519
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (800.267 ms) : 0, 800267
BytebuddyAgent [candidate] (800.439 ms) : 0, 800439
GlobalTracer [baseline] (230.164 ms) : 0, 230164
GlobalTracer [candidate] (229.976 ms) : 0, 229976
AppSec [baseline] (52.607 ms) : 0, 52607
AppSec [candidate] (51.931 ms) : 0, 51931
Debugger [baseline] (5.991 ms) : 0, 5991
Debugger [candidate] (5.982 ms) : 0, 5982
Remote Config [baseline] (593.411 µs) : 0, 593
Remote Config [candidate] (601.944 µs) : 0, 602
Telemetry [baseline] (7.93 ms) : 0, 7930
Telemetry [candidate] (7.872 ms) : 0, 7872
IAST [baseline] (26.383 ms) : 0, 26383
IAST [candidate] (28.033 ms) : 0, 28033
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (798.214 ms) : 0, 798214
BytebuddyAgent [candidate] (799.492 ms) : 0, 799492
GlobalTracer [baseline] (230.44 ms) : 0, 230440
GlobalTracer [candidate] (231.551 ms) : 0, 231551
AppSec [baseline] (52.844 ms) : 0, 52844
AppSec [candidate] (49.339 ms) : 0, 49339
Debugger [baseline] (6.1 ms) : 0, 6100
Debugger [candidate] (5.946 ms) : 0, 5946
Remote Config [baseline] (607.784 µs) : 0, 608
Remote Config [candidate] (605.111 µs) : 0, 605
Telemetry [baseline] (7.892 ms) : 0, 7892
Telemetry [candidate] (7.877 ms) : 0, 7877
IAST [baseline] (25.951 ms) : 0, 25951
IAST [candidate] (29.975 ms) : 0, 29975
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~3d21dd596f, baseline=1.50.0-SNAPSHOT~3853c65296

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.028 s) : 0, 1027755
Total [baseline] (11.093 s) : 0, 11093463
Agent [candidate] (1.02 s) : 0, 1020161
Total [candidate] (11.065 s) : 0, 11065248
section appsec
Agent [baseline] (1.171 s) : 0, 1170985
Total [baseline] (11.23 s) : 0, 11229780
Agent [candidate] (1.172 s) : 0, 1171758
Total [candidate] (11.231 s) : 0, 11231129
section iast
Agent [baseline] (1.157 s) : 0, 1157073
Total [baseline] (11.37 s) : 0, 11369817
Agent [candidate] (1.148 s) : 0, 1147888
Total [candidate] (11.378 s) : 0, 11377640
section profiling
Agent [baseline] (1.263 s) : 0, 1262908
Total [baseline] (11.482 s) : 0, 11482399
Agent [candidate] (1.271 s) : 0, 1271484
Total [candidate] (11.417 s) : 0, 11417013
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.028 s -
Agent appsec 1.171 s 143.23 ms (13.9%)
Agent iast 1.157 s 129.318 ms (12.6%)
Agent profiling 1.263 s 235.153 ms (22.9%)
Total tracing 11.093 s -
Total appsec 11.23 s 136.317 ms (1.2%)
Total iast 11.37 s 276.354 ms (2.5%)
Total profiling 11.482 s 388.936 ms (3.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.02 s -
Agent appsec 1.172 s 151.598 ms (14.9%)
Agent iast 1.148 s 127.728 ms (12.5%)
Agent profiling 1.271 s 251.323 ms (24.6%)
Total tracing 11.065 s -
Total appsec 11.231 s 165.881 ms (1.5%)
Total iast 11.378 s 312.392 ms (2.8%)
Total profiling 11.417 s 351.765 ms (3.2%) 
gantt
    title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~3d21dd596f, baseline=1.50.0-SNAPSHOT~3853c65296

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (686.924 ms) : 0, 686924
BytebuddyAgent [candidate] (681.886 ms) : 0, 681886
GlobalTracer [baseline] (241.311 ms) : 0, 241311
GlobalTracer [candidate] (239.55 ms) : 0, 239550
AppSec [baseline] (56.754 ms) : 0, 56754
AppSec [candidate] (57.146 ms) : 0, 57146
Debugger [baseline] (6.172 ms) : 0, 6172
Debugger [candidate] (6.141 ms) : 0, 6141
Remote Config [baseline] (723.866 µs) : 0, 724
Remote Config [candidate] (716.578 µs) : 0, 717
Telemetry [baseline] (12.239 ms) : 0, 12239
Telemetry [candidate] (11.201 ms) : 0, 11201
section appsec
BytebuddyAgent [baseline] (703.465 ms) : 0, 703465
BytebuddyAgent [candidate] (703.318 ms) : 0, 703318
GlobalTracer [baseline] (233.904 ms) : 0, 233904
GlobalTracer [candidate] (234.088 ms) : 0, 234088
AppSec [baseline] (174.415 ms) : 0, 174415
AppSec [candidate] (175.164 ms) : 0, 175164
Debugger [baseline] (5.903 ms) : 0, 5903
Debugger [candidate] (5.947 ms) : 0, 5947
Remote Config [baseline] (614.983 µs) : 0, 615
Remote Config [candidate] (613.267 µs) : 0, 613
Telemetry [baseline] (7.273 ms) : 0, 7273
Telemetry [candidate] (7.334 ms) : 0, 7334
IAST [baseline] (21.888 ms) : 0, 21888
IAST [candidate] (21.801 ms) : 0, 21801
section iast
BytebuddyAgent [baseline] (806.678 ms) : 0, 806678
BytebuddyAgent [candidate] (800.71 ms) : 0, 800710
GlobalTracer [baseline] (231.757 ms) : 0, 231757
GlobalTracer [candidate] (230.343 ms) : 0, 230343
AppSec [baseline] (51.438 ms) : 0, 51438
AppSec [candidate] (49.224 ms) : 0, 49224
Debugger [baseline] (6.058 ms) : 0, 6058
Debugger [candidate] (5.894 ms) : 0, 5894
Remote Config [baseline] (605.697 µs) : 0, 606
Remote Config [candidate] (582.329 µs) : 0, 582
Telemetry [baseline] (8.01 ms) : 0, 8010
Telemetry [candidate] (7.934 ms) : 0, 7934
IAST [baseline] (28.874 ms) : 0, 28874
IAST [candidate] (29.796 ms) : 0, 29796
section profiling
BytebuddyAgent [baseline] (674.26 ms) : 0, 674260
BytebuddyAgent [candidate] (679.468 ms) : 0, 679468
GlobalTracer [baseline] (359.931 ms) : 0, 359931
GlobalTracer [candidate] (360.712 ms) : 0, 360712
AppSec [baseline] (61.196 ms) : 0, 61196
AppSec [candidate] (61.794 ms) : 0, 61794
Debugger [baseline] (6.027 ms) : 0, 6027
Debugger [candidate] (6.141 ms) : 0, 6141
Remote Config [baseline] (646.209 µs) : 0, 646
Remote Config [candidate] (650.726 µs) : 0, 651
Telemetry [baseline] (8.003 ms) : 0, 8003
Telemetry [candidate] (8.281 ms) : 0, 8281
ProfilingAgent [baseline] (102.163 ms) : 0, 102163
ProfilingAgent [candidate] (103.329 ms) : 0, 103329
Profiling [baseline] (102.187 ms) : 0, 102187
Profiling [candidate] (103.353 ms) : 0, 103353
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-06-11T08:10:09 2025-06-11T08:20:58
git_branch master smola/remove-appsec-no-iast-benchmark
git_commit_date 1749573424 1749628630
git_commit_sha 3853c65 3d21dd5
release_version 1.50.0-SNAPSHOT~3853c65296 1.50.0-SNAPSHOT~3d21dd596f
start_time 2025-06-11T08:09:55 2025-06-11T08:20:42
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1749630518 1749630518
ci_job_id 976256583 976256583
ci_pipeline_id 67415803 67415803
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-ytwrhy75-project-304-concurrent-0-hhb1pgpb 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-ytwrhy75-project-304-concurrent-0-hhb1pgpb 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
thresholds_or_results results results
variant iast iast

Summary

Found 2 performance improvements and 4 performance regressions! Performance is the same for 4 metrics, 16 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:iast worse
[+18.148µs; +68.593µs] or [+3.424%; +12.941%]		 unstable
[-2960.702op/s; +1078.349op/s] or [-37.009%; +13.479%]		 573.420µs 7058.824op/s 530.050µs 8000.000op/s
scenario:load:petclinic:code_origins worse
[+35.263ms; +37.218ms] or [+113.826%; +120.135%]		 unstable
[-95.359op/s; -73.729op/s] or [-61.156%; -47.284%]		 67.220ms 71.385op/s 30.980ms 155.929op/s
scenario:load:petclinic:iast unstable
[+50.201ms; +51.510ms] or [+524.080%; +537.753%]		 worse
[-457.681op/s; -416.356op/s] or [-88.681%; -80.674%]		 60.434ms 79.080op/s 9.579ms 516.099op/s
scenario:load:petclinic:no_agent better
[-680.724µs; -632.440µs] or [-8.113%; -7.538%]		 better
[+28.381op/s; +64.990op/s] or [+4.825%; +11.048%]		 7.734ms 634.921op/s 8.390ms 588.235op/s
scenario:load:petclinic:tracing worse
[+2.562ms; +2.727ms] or [+26.464%; +28.165%]		 unstable
[-143.769op/s; -72.597op/s] or [-28.215%; -14.247%]		 12.326ms 401.371op/s 9.682ms 509.554op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~3d21dd596f, baseline=1.50.0-SNAPSHOT~3853c65296
    dateFormat X
    axisFormat %s
section baseline
no_agent (8.39 ms) : 8368, 8413
.   : milestone, 8390,
appsec (390.77 µs) : 354, 428
.   : milestone, 391,
code_origins (30.98 ms) : 30879, 31081
.   : milestone, 30980,
iast (9.579 ms) : 9536, 9621
.   : milestone, 9579,
profiling (1.092 ms) : 1037, 1147
.   : milestone, 1092,
tracing (9.682 ms) : 9632, 9731
.   : milestone, 9682,
section candidate
no_agent (7.734 ms) : 7711, 7756
.   : milestone, 7734,
appsec (52.407 ms) : 51703, 53110
.   : milestone, 52407,
code_origins (67.22 ms) : 65940, 68501
.   : milestone, 67220,
iast (60.434 ms) : 59575, 61294
.   : milestone, 60434,
profiling (43.717 ms) : 43118, 44316
.   : milestone, 43717,
tracing (12.326 ms) : 12230, 12422
.   : milestone, 12326,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 8.39 ms [8.368 ms, 8.413 ms] -
appsec 390.77 µs [353.532 µs, 428.009 µs] -7.999 ms (-95.3%)
code_origins 30.98 ms [30.879 ms, 31.081 ms] 22.59 ms (269.2%)
iast 9.579 ms [9.536 ms, 9.621 ms] 1.189 ms (14.2%)
profiling 1.092 ms [1.037 ms, 1.147 ms] -7.298 ms (-87.0%)
tracing 9.682 ms [9.632 ms, 9.731 ms] 1.291 ms (15.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 7.734 ms [7.711 ms, 7.756 ms] -
appsec 52.407 ms [51.703 ms, 53.11 ms] 44.673 ms (577.6%)
code_origins 67.22 ms [65.94 ms, 68.501 ms] 59.487 ms (769.2%)
iast 60.434 ms [59.575 ms, 61.294 ms] 52.701 ms (681.5%)
profiling 43.717 ms [43.118 ms, 44.316 ms] 35.984 ms (465.3%)
tracing 12.326 ms [12.23 ms, 12.422 ms] 4.592 ms (59.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/remove-appsec-no-iast-benchmark
git_commit_date 1749573424 1749628630
git_commit_sha 3853c65 3d21dd5
release_version 1.50.0-SNAPSHOT~3853c65296 1.50.0-SNAPSHOT~3d21dd596f
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1749630765 1749630765
ci_job_id 976256584 976256584
ci_pipeline_id 67415803 67415803
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-qrcmbjps-project-304-concurrent-1-1lt71mfn 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-qrcmbjps-project-304-concurrent-1-1lt71mfn 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~3d21dd596f, baseline=1.50.0-SNAPSHOT~3853c65296
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.96 s) : 14960000, 14960000
.   : milestone, 14960000,
appsec (14.677 s) : 14677000, 14677000
.   : milestone, 14677000,
iast (19.099 s) : 19099000, 19099000
.   : milestone, 19099000,
iast_GLOBAL (18.049 s) : 18049000, 18049000
.   : milestone, 18049000,
profiling (15.089 s) : 15089000, 15089000
.   : milestone, 15089000,
tracing (15.04 s) : 15040000, 15040000
.   : milestone, 15040000,
section candidate
no_agent (15.32 s) : 15320000, 15320000
.   : milestone, 15320000,
appsec (14.831 s) : 14831000, 14831000
.   : milestone, 14831000,
iast (18.585 s) : 18585000, 18585000
.   : milestone, 18585000,
iast_GLOBAL (18.085 s) : 18085000, 18085000
.   : milestone, 18085000,
profiling (15.266 s) : 15266000, 15266000
.   : milestone, 15266000,
tracing (14.877 s) : 14877000, 14877000
.   : milestone, 14877000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.96 s [14.96 s, 14.96 s] -
appsec 14.677 s [14.677 s, 14.677 s] -283.0 ms (-1.9%)
iast 19.099 s [19.099 s, 19.099 s] 4.139 s (27.7%)
iast_GLOBAL 18.049 s [18.049 s, 18.049 s] 3.089 s (20.6%)
profiling 15.089 s [15.089 s, 15.089 s] 129.0 ms (0.9%)
tracing 15.04 s [15.04 s, 15.04 s] 80.0 ms (0.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.32 s [15.32 s, 15.32 s] -
appsec 14.831 s [14.831 s, 14.831 s] -489.0 ms (-3.2%)
iast 18.585 s [18.585 s, 18.585 s] 3.265 s (21.3%)
iast_GLOBAL 18.085 s [18.085 s, 18.085 s] 2.765 s (18.0%)
profiling 15.266 s [15.266 s, 15.266 s] -54.0 ms (-0.4%)
tracing 14.877 s [14.877 s, 14.877 s] -443.0 ms (-2.9%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~3d21dd596f, baseline=1.50.0-SNAPSHOT~3853c65296
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.475 ms) : 1463, 1486
.   : milestone, 1475,
appsec (2.405 ms) : 2356, 2453
.   : milestone, 2405,
iast (2.183 ms) : 2122, 2245
.   : milestone, 2183,
iast_GLOBAL (2.228 ms) : 2167, 2289
.   : milestone, 2228,
profiling (2.021 ms) : 1972, 2070
.   : milestone, 2021,
tracing (2.008 ms) : 1961, 2056
.   : milestone, 2008,
section candidate
no_agent (1.474 ms) : 1463, 1486
.   : milestone, 1474,
appsec (2.402 ms) : 2353, 2451
.   : milestone, 2402,
iast (2.188 ms) : 2127, 2249
.   : milestone, 2188,
iast_GLOBAL (2.236 ms) : 2175, 2298
.   : milestone, 2236,
profiling (2.038 ms) : 1989, 2087
.   : milestone, 2038,
tracing (1.999 ms) : 1952, 2046
.   : milestone, 1999,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.475 ms [1.463 ms, 1.486 ms] -
appsec 2.405 ms [2.356 ms, 2.453 ms] 930.033 µs (63.1%)
iast 2.183 ms [2.122 ms, 2.245 ms] 708.82 µs (48.1%)
iast_GLOBAL 2.228 ms [2.167 ms, 2.289 ms] 753.255 µs (51.1%)
profiling 2.021 ms [1.972 ms, 2.07 ms] 546.478 µs (37.1%)
tracing 2.008 ms [1.961 ms, 2.056 ms] 533.794 µs (36.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.463 ms, 1.486 ms] -
appsec 2.402 ms [2.353 ms, 2.451 ms] 927.823 µs (62.9%)
iast 2.188 ms [2.127 ms, 2.249 ms] 713.653 µs (48.4%)
iast_GLOBAL 2.236 ms [2.175 ms, 2.298 ms] 762.048 µs (51.7%)
profiling 2.038 ms [1.989 ms, 2.087 ms] 563.575 µs (38.2%)
tracing 1.999 ms [1.952 ms, 2.046 ms] 524.565 µs (35.6%)

@smola smola merged commit 089cf8f into master Jun 11, 2025
520 of 522 checks passed
@smola smola deleted the smola/remove-appsec-no-iast-benchmark branch June 11, 2025 10:48
@github-actions github-actions bot added this to the 1.50.0 milestone Jun 11, 2025
sarahchen6 pushed a commit that referenced this pull request Jun 12, 2025
@smola @sarahchen6
Remove appsec_no_iast benchmark scenarios (#8958)
41abd0e
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@bric3 bric3 bric3 approved these changes

@manuel-alvarez-alvarez manuel-alvarez-alvarez manuel-alvarez-alvarez approved these changes

Assignees

No one assigned

Labels

comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes

Projects

None yet

Milestone

1.50.0

Development

Successfully merging this pull request may close these issues.

3 participants

@smola @bric3 @manuel-alvarez-alvarez